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Interpolation of images 



FIELD OF THE INVENTION 

The invention relates to a method of interpolating pixel values of pixels of an 
image. The invention further relate to a warped distance interpolator, and to a display 
BpparBtus con^nising such a warped distance interpolator. 

5 

BACKGROUND OF THE INVENTION 

The warped distance concept (WaDi) is known firom the publication '"Warped 
distance for space-variant linear image interpolation", IEEE Transactions on Image 
processing, voL 8 no. S, May 1999 by G. Ramponi. The Warped Distance concept for linear 

10 intexpolators adapts a linear interpolator to the local pixel configuration of natural (non 
graphic) images. Particularly, the aim was to prevent edges fiom being blurred by the 
interpolation process. 

The WaDi concept performs a one dimensional interpolation. In the horizontal 
direction, an interpolated san^le could be a linear combination of the two neighboring 

IS horizontal san^les sandwiching the sample to be interpolated. The linear combination 

depends on the fiactional position (or phase) of the sanq>le to be interpolated with respect to 
the two neighboring horizontal samples. The interpolation at a luminance edge is adapted by 
locally warping the phase, such that the sample to be interpolated is virtually moved toward 
the ri^t or left input saixq)le. This warping is stronger in {presence of luminance edges and 

20 l^s on smooth parts. In order to determine the amount of warping, four pixels around the one 
that has to be interpolated are analyzed, and an asymmetry value is confuted such that the 
sample to be interpolated is moved towards the fiat area it belongs to. 

An interpolation of a 2D imag? is obtamed by first performing the WaDi 
algorithm on the input san^les in the horizontal direction to obtain interpolated horizontal 

25 samples and then in the vertical direction on the interpolated horizontal samples. It is a 
disadvantage that a relatively complex algcmthm is required. 
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SUMMARY OF THE INVENTION 

It is an object of the invention to perfonn a WaDi interpolation on a two- 
dimensional image which provide a higher performance algorithm. 

A first asfpect of the invention provides a metiiod of interpolating sanq>le 
S values of sanq>les of an image as claimed in claim 1. A second aspect of the invention 

provides a warped distance interpolator as claimed in claim 7. A third aspect of Ifae invention 
provides a display s^yparatus as claimed in claim 8. Advantageous embodiments in 
accordance witii the invention are defined in the dependent claims. 

The metiiod of interpolating san^le values of samples of an image determines 
10 a direction of a local gradient for a particular one of the sanoples from sample values 

neighboring the particular one of the sauries. This local gradient indicates the direction of 
change of the values of the samples at the position of the particular sample. For example if 
the image comprises a white left area and a black right area and the particular sample is near 
to a vertical border between the white and the black area, the gradient will direct in the 
IS horizontal direction towards the white area. Usually, the local gradient is determined for each 
output sample of the image. 

Then, a warping &ctor for a watped distance interpolator WaDi is determined 
using interpolator input values arranged in the gradient direction of tiie particular saoqple. 
Thus, the interpolator input values for the well known WaDi interpolator are selected on a 
20 line which extends through the particular sample in the direction of the local gradient 

Because usually, these interpolator input values do not coincide with the input 
san^les, the interpolator input values have to be interpolated firom i]q>ut saicqple values 
neighboring the interpolator input values. 

The determination of the warping &ctor in the direction of the local gradient 
25 has the advantage that the WaDi inteipolation can be performed in one step, instead of 

performing the WaDi interpolation step successively in the horizontal and vertical direction. 

In an embodiment in accordance with the invention as defined in claim 2, the 
WaDi interpolation is applied in a system in which an output image is a scaled ii^ut image. 
This approach is particularly interesting for scaling factors which are at least 2, which means 
30 that the distance between the output samples is at most half of the distance between hxpxA 

sanqples. The distance may refer to the time closed between two successive samples or to tiie 
actual position on a display screen when these samples are displayed on the pixels of the 
display screen. 
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In fhis embodiment, the output image is first roughly interpolated fiom the 
input image to obtain raw interpolated data, for example by using a simple bilinear 
interpolator. The rraultant low-pass version of the image makra the gradient estibtnation less 
susceptible to noise. A more con^lex interpolation, fixr example a cubic interpolation, may 
be used but has the drawback that a higiher computational conoplexily results. The local 
gradient is determined by using the output pkels or raw interpolated data supplied by the 
suqple interpolator. 

In tiie embodiment in accordance with the invention as defined in claim 3, the 
local gradient is determined in the input map by using the icput sample values. The local 
gradients found are m^^ped to ou^ut sample positions of the output samples in the ou^ut 
map. This mapping may be performed, for example, by using the nearest neighbor ^preach, 
or by linear interpolation. This approach does not require the raw interpolation step and thus 
takes less conrputational effort 

In the embodiment in accordance with the invention as defined in claim 4, the 
samples are arranged in a matrix in in^ch the position of the sanqiles is defined by the 
orthogonal x, y coordinates. Well known Sobel filters are used to estimate the direction of the 
local gradient 

In the CTibodiment in accordance with the invention as defined in claim 5, the 
distance between the adjacent interpolator input values used to determine the gradient is 
substantially equal to the distance between adjacent input samples to provide a coherent 
interpolation. 

In the embodiment in accordance with the invention as defined in claim 6, the 
warping factor is projected on flie x and y coordinates to control the WaDi interpolator to 
modify the distances (to warp the sanoples in the time domain or the pixels in the space 
domain) in the x and in the y direction in accordance with the projected warping &ctors. 
Thus, instead of performing the standard WaDi algorithm two times, first in the x direction to 
obtain intermediate results, and then in the y direction using the intermediate results, the 
components of the single warping &ctor are used to directiy obtain the inteipolated output 
samples fimn the input samples. 

These and other aspects of the invention are apparent fix>m and will be 
elucidated with reference to the embodiments described hereinafter. 

BRIEF DESCaEOPTION OF THE DRAWINGS 
In the drawings: 
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Fig. 1 shows a known two step interpolation approach. 
Fig. 2 shows a waveform for elucidating the known Waiped Distance concept, 
Fig. 3 shows, for a particular oulput sample, the arrangement of the 
interpolator input values in the direction of the local gradient in accordance with an 
S embodiment of 1be invention. 

Fig. 4 shows a flowchart for elucidating an embodiment of Ihe one step 
Warped Distance concept in accordance with the inventiim. 

Fig. 5 shows a flowchart ofpartofanother embodiment of the one step 
Warped Distance concept in accordance with the invention, and 
10 Fig. 6 shows a block diagram of a display appaxatus comprising the Warped 

Distance interpolator in accordance with the invention. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
Fig. 1 shows a prior art two step interpolation ^>proach. 

15 In weU known linear interpolation techniques, a two-dimensional input image 

n (see Fig. 6) is represented by input samples Pi which usually are sanqpled equidistant such 
that tiie input samples Pi are positioned on a rectangular grid which has ax and ay direction. 
The input sample Pi are also referred to as input pixels Pi which is based on the &ct that if 
the input san^les Pi were displayed on a display screen DS (see Fig. 6), the rectangular grid 

20 in time would show as a rectangular grid in position on the display screen DS. The values of 
the iitput sanqples Pi determine the int^isity of the input pixels Pi. The output samples Po 
actually to be displayed on the disfplay sbreen DS may have to be interpolated from the input 
san^les Pi to obtain oulput pixels Po corresponding to the pixels on the display screen DS. 
This is for example required if the resolution of the display screen DS is fixed, such as is the 

25 case for matrix displays and the resolution of the input image n differs fiom the resolution of 
the display screen DS. 

Fig. 1 shows the interpolation of an output sample Po which is positioned ixh 
between input sarnples Pi. The value of the i-th input sample Pi of the j-th row of samples of 
the input image is denoted by iflC^yj). The value of the output sample Po is denoted by 

30 fo(x,y). In Fig. 1 the four input san9>les Pi are shown which are nearest to the output sample 
Po. 

First, the input image n is interpolated in the horizontal direction x. In the row 
yj, the value fl(x,yj) of a tenoporary sample Ptl is determined using the value fC^yj) of the 
iiqput sample Pi in tiie column Xi and the value f(xHi,yj) of the input sainple Pi in the colunm 
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Xifi. In the same matmer, in the row yj^i, the vahie ft(x,y|f i) of a temporary san^le Pt2 is 
determmed using the value f(Xj,yjfi) of the input sample Pi in the column xi and the value 
fl[xifi,yjfi) of the irqput san^le Pi in the column xh-i. Then, the value fi>(x,y) of the output 
pbcel Po is determined using the temporary sanq>les Ptl andPt2. 
S The values of die tenqK>rary sanq>les Ptl and Pt2 may be calculated as 

ft(x,yfe) = (l-Sx) fl[xi,yk) + Sxfl[xw,yk) k= j, j+1 (1) 

wherein Sx is the distance in die x-direction betwem x and ^. 

The value of Ihe output sample Po may be calculated as 
fo(x,y) = (1-Sy) fl(x,yj) + Sy ft(x,yj,.i) (2) 
10 wherein Sy is the distance in the y-direction between y and yj. 

Fig. 2 shows a waveform for elucidating the known Warped Distance concept 
In the same maimer as elucidated with respect to Fig. 1, the Warped Distance concept 
(further referred to as WaDi) determines the value of the output sample Po in two steps. The 
difference wifli Ihe linear inteipolationeluddated with resp^ 1 is that the distances 

IS Sz and Sy are ad^ted (warped) according to a local feature of the issput image n to increase 
the perceived quality of the interpolated ou^ut imag^ OI (see Fig. 6). Thus, the WaDi 
interpolates the input image n by qyplying first the linear interpolation algorithm in the x- 
direction with an adqsted distance Sx to obtain tenqporaiy o 

samples Pt Then, the WaDi applies the linear interpolation algorithm in the y-direction on 
20 the intermediate interpolated samples Pt with an adsqpted distance Sy to obtain the output 
sample Po. 

The WaDi warps the distances Sx and Sy based on de warping &ctor A: 
A = (|a3.al |-|a4-a2|)/(L-l) (3) 
wherein the coefficients al to a4 are input sample values f(xi,yj) in the neighborhood of the 
25 output sample Po to be interpolated Depending on the step performed by the WaDi, fee input 
samples al to a4 are arranged either in the x or in the y direction. L is the number of levels 
available to display the samples, for example, for 8 bit luminance signals, L = 256. 

Fig 2 shows a waveform and input samples Pi for elucidating ihe WaDi in the 
x-direction. The fimction f(x) shows an example of a transition in the input video image II. 
30 Particularly, the aim of the WaDi was to prevent edges ficom being blurred by 

the interpolation process. If the intermediate sample Pttobe interpolated is in a position u 
(not shown) in the output domain, the ccnresponding position of the output sample Po in the 
input domain is Xr=u/z, wherein z is the scaling &ctor. The input domain comprises the iiq>ut 
pixels Pi and the output domain comprises the output pixels Po. The fiactional position or 
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phase Sx = x-xo, wherein xo is the left hand input sample Pi next to x. This input sanqple Pi at 
xo has a sample value a2, Ifae iiqput sanq)le Pi at xi has the value a3, the iiq)ut san:q)le Pi atx.i 
has the value al and the iiq)ut sanoyple Pi at X2 has the value a4 which is 1 in the exan:q>les 
shown. If a simple tent (bilinear) kernel is applied as the base kernel of the linear interpolator 
5 of the WaDi, the ou^ut value would be: 

Mx) = a " Sx)fix^ ) + Sbcfix, ) = (1 - &c)a2 + Sxa3 (4) 



wherein xi is the right hand input sample next to x. 

10 Generally speaking, the interpolated sainple ft(x) is a Unear combination of the 

neighboring samples f(Xo) and :Q[xi), which linear combination depends on the Pactional 
position (or phase) Sx. The interpolation at a luminance edge is adapted by locally warping 
the phase Sx, suchthatxisvirtuaUy moved toward the right or left input sample Pi. This 
warping is stronger in presence of luminance edges and less in smooth parts. In order to 

IS determine the amount of warping, tiie four samples Pi at positions x.i, Xq, xi andx2 around 
the sample at position xtiiat has to be interpolated are analyzed, and an asymmetry value or 
warping &ctor A is confuted: 



20 



, ■ " /(^--i)! ^ 1/(^2) " /(^o)| _ 1^3 - all - \a4 - a2\ 



wherein L is the number of allowed luminance levels (256 in case of 8-bit quantization). And 
X.1 is the input sample preceding the iiiput sanxple xo, and xa is the iiq>ut sample succeeding 
the input sample xx. Provided the sigmoidal edge model applies, tbe asymmetry value A in 
equation (5) is 0 when the edge is perfectiy symmetric, and close to 1 (or -1) when the edge 
2S is more flat in the right (left) hand side of the sample Pt 

The sample Pt to be interpolated should be moved towards the flat area it 
belongs to. Therefore, when the warping factor A>0, the phase Sx has to be increased, while 
if the warping &ctor A<0 the phase Sx has to be decreased This is obtained by the following 
warping function: 

30 



iS5t'=iS3C-ib4iSc(iSi:-l) (6) 
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where k is the general amount of warping whidi may be controllable. The waiped phase Sx' 
remains in the range [0,1], if kis in the range [0,1]. It has to be noted Ifaat the two extremes 
SxF=0 and Sf=1 are maintained (Sx'=0 and Sx'=l, respective^), regardless the value of A 
and k. The warped intermediate sample is indicated as WP. 
S In Hie same marmer as elucidated for determining the warped intermediate 

samples WP by perfinming the known WaDi in the x direction, the WaDi has to interpolate 
the warped intermediate samples WP in the y-direction to obtain tiie output sani^le Po. 

Changing the phase Sx is equivalent to moving the position of the san:q>le to 
be interpolated Pt or Po in the intermediate or output grid, respectively, before ^iplying the 

10 linear filter equation of the WaDi, as if it were warped. Actually, the final position of the 
sanq)!^ Pt or Po is not changed, the algorithm assigns to the sanq)le to be interpolated Pt or 
Po the value obtained as if it were in the warped position. The &ctor k controls the amount of 
warping, a greater value of k increases the sharpening effect To be sure that the phase Sx lies 
within the interval 0 to 1, the &ctor khas to be selected < 1. But, fcur natural images, the 

IS &ct(Mr kis preferably larger than 1. Because | A | is usually small, even at these larger &ctors 
kthe phase Sx is still smaller than 1. If the phase Sx becomes larger than 1 itisclippedto 1, 
or if it becomes smaller than 0 it is clipped to 0. 

In an embodiment in accordance with the invention, compared to the known 
WaDi, the warping function is determined only once, in the direction of a local gradient (6) in 

20 either the input image or the output image. 

Fig« 3 shows, for a particular output sample, how the interpolator input values 
al to a4 may be arranged in the direction of the local gradient in accordance with an 
embodiment of tiie invention. The input samples Pi are indicated by the large dots spaced 
over distance d in the x, y space. The output samples Po are indicated by the intersections of 

25 the horizontal and vertical lines which form the output grid. Fig. 3 thus shows, by way of 
example, a scaling with a &ctor 2. The line TR indicates the border between a black area (at 
the left hand side of the border TR) and a white area. The direction of the local gradient at the 
position of the ou^ut pixel P is indicated by the dotted line DLG which is perpendicular to 
theborderTR. 

30 The invention is based on changing the phases Sx and Sy, not according to 

local 1 -dimensional features in the x or the y direction, respectively, but fiom 2-dimensional 
features. Thus, the warping &ctor A is calculated in one step along the local gradient 
direction 6 which maybe diagonal. It is not requked to determine a &ctor A separately in the 
x-direction and in the y-direction. 
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As discussed with r^ect to the known WaDi, the asymmetry value or 
warping &ctor A is still calculated by using input valura al to a4 which are positioned in Hie 
neighborhood of fte output sample P of which the value has to be determined But, in 
accordance with an embodiment of the invention, these ixtput values are neither tiie input 
samples Pi in the x-direction nor the warped tenq[>orary samples Pt in the y-direction. Now, 
the input values al to a4 are arranged in the direction of a local gradient 6. As shown in Fig. 
3, the input values al to a4 used to determine the warping &ctor A are i>osi1ioned on the line 
DLG, thus in the direction of the local gradient G. Usually, these input values al to a4 will not 
coincide with input san^les Pi and thus will have to be interpolated fiom the h^ut samples 
Pi, Preferably, the distance d between two successive ones of the input values al to a4 is 
equal to the sampling period of the san^les Pi of the input image n to keep coherence with 
the image interpolation stage. 

This sampling period corresponds to the distance d between two successive 
input san^les Pi in either the x or the y direction. For example, the input valu^ al to a4 are 
obtained by a bilinear interpolation in the positions shown in Fig. 3. These positions of the 
ixiput values al to a4 are selected along the maximinn gradient direction 8, at distances — 
l.Sd, -0,S'dy O.S-d, l,S-d, respectively, from tiie (3q>,yp) position of the ou^ut pixel P tobe 
interpolated, wherein d is the distance between two successive input pixels Pi in the input 
grid. The coordinates X and y of the input values al to a4 are determined with the following 
equations: 

jc = + (i - 2.5)d • cos(e ) 

wherein i is the index of the input value ai. 

Two possible embodiments are elucidated for determining the local gradient 6. 
In the fust embodiment, the input image n is first interpolated with a known algorithm, for 
exanxple with a bilinear filter, to obtain rou^y interpolated ou^ut samples. The local 
gradient 6 is determined in the output domain fixnn these output samples. For example, by 
using a Sobel filter. Possible masks of Sobel filters to obtain a value of the directional 
derivative along x and y directions are: 



Sobel ^ = 



fl/4 0 -1/4' 
1/2 0 -1/2 
^1/4 0 -1/4^ 



Sobel y = 



^-1/4 -1/2 -1/4^ 
0 0 0 

1/4 1/2 1/4 , 

J 



The direction of the gradient 9 at the position Xi,yj is then estimated as follows: 
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Qix,,yj)^Brcbm{^^ ' (7) 

wherein fl is flxe result of the rough interpolation of the isput image II, and 6 is an angle 
which varies between -7c/2 and tU2. 

The gradient evaluation has been performed by using Sobel's method in the 
S ou^ut domain. A pre-proc^sing, for exan^le a S]nq>le bilinear interpolator, is required to 
obtain raw intetpolated ou^ut sanq>les which represent a low-pass version of the ii^ut image 
n and thus the gradient estimation is less noise-SCTsitive. The rough interpolation may be 
perfcmned with more coniplex methods, for exan^le, such as a bicubic interpolation, which 
of course has the drawback that a higher conq[)utational conq>lexity is required but which 

10 provides better gradient values 8. Al&ough this first embodiment i»x>vides a very good 
gradient estimate, it adds a considerable oveihead to the total processing time. 

In anotibter embodiment, a less optimal solution to estimate the gradient 8 is to 
s^ly the Sobel filters in Ifae ii^ut domain (using the input sanq>les Pi) and then m^ these 
gradient values to tiie output grid. ThismiE^ingmaybe perfimned, for example, by using the 

IS nearest neighbor approach, or by linearly interpolating the estimated gradient values 8. 

If very high values of the interpolation &ctor are required, the pass band of 
Sobel filter could become too large and the gradient estimation would not work. For high 
iaterpolation &ctors, it is thus better to resize the image in two steps, performing the whole 
algorithm twice. For example, an interpolation by a &ctor of 8 may become an interpolation 

20 by a cascade of interpolations by a &ctor of 2. Alternatively, the Sobel filters may be used to 
proems a mid-resolution version of Ihe ixtput image n to obtain gradient values 6. The same 
gradient values 8 are assigned to a group of ou^ut pixels Po in the ultra-high resolution 
ou^utgrid. 

Fig. 4 shows a flowchart for elucidating an embodiment of the one step 
25 Warped Distance concept in accordance with the invention. 

The step 1 receives the input sanq>les Pi(iJ) and supplies local gradients 
8(m,n) (also referred to as gradients). In the first embodiment as elucidated before, the step 
10 interpolates the ii^>ut pixels Pi(iJ) to obtain estimated output samples V(pyfi) which are 
inputted into the Sobelx filtering step 1 1 and the Sobely fiiltering step 12. In the dividing step 
30 13,theoutpmofthe Sobely filtering step 12 is divided by the output of the Sobelx filtering 
step 11. Step 14 determines the gradient 6(m,n) by calculating the arctan of the output of the 
dividing step 13. 

The step 2 performs Ihe local asymmetry estimation also referred to as 
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the determination of the warping factor A. In step 20, the four input values al to a4 are 
selected to be determined in positions along the direction of the local gradient 0, thus on the 
line DLG. P(m;Q) is the output sample of which the value has to be interpolated, and 6(P) is 
the local gradient at tiie positicm of this output saniple P(m,n). In step 21, flie values of tiie 

S ixxput values al to a4 are determined by interpolation of the input sanq>les Pi surcoimding the 
positions of the ii^ut values al to a4. Preferably, a bilinear inteipolation is used* In step 22, 
the warping &ctor A is determined according to equation S in one step from the interpolated 
ioput values al to a4. 

The step 3 determines the values of the output samples Po(iJ). Step 30 

10 receives Hie gradients G(nQi,n) and the warping fector A to compute the local warping 

components or distances SLx and Sly by warping the distances Sx and Sy in the same manner 
as equation 6 did for the known WaDi approach. To obtain the result, the warping v^or A is 
projected onto the x and y direction. The following equations perform these operations: 

15 SL, = 5, + ib4cos(e)/4 (8) 

ffl^ =5^^+Jb4[sm(0)/4 (9) 



As in the known WaDi ^>proach, k is a multiplying &ctor that adjusts the 
distortion intensity, 0 is the angle which defines the gradient direction. The optional fsictor 4 

20 at the denominator is provided only for comparison with the known WaDi results. Note that 
the k &ctor can be varied on a sample-per-sample (or if referring to the output pixels on a 
pixel by pixel) basis, by means of an (external) automatic control. For example, a natural 
content detector can be used to estimate the probability whether the local pixel is part of a 
photogr^h. Depending on this estimate the warping effect can be tuned via the k &ctor to 

25 obtain the best result 

The optional clipping step 31 clips the values of the local waxping distances 
SLx and Sly to keep them in a range fiom zero to one, including the limits. Otherwise, it may 
happen, especially if the multiplying factor k>4, that the warping distances SLx or SLy are 
smaller than zero or greater than one which means that the output pixel Po to be interpolated 

30 would move outside the square formed by the four nearest input pixels K, which will not 

provide a good hiterpolation. The elided warping distances are denoted by SLCx and SLCy. 

It has to be noted that based on equations 8 and 9, that if the phase Sxr=0 and 
the phase Sy=0, and if A is not zero, the warping distaaces SLx and SLy may not be equal to 
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zero. Thus, oulpiit pixels Po(]imi) interpolated in points of the output grid that conespond to 
points in the input grid may have a value difGsient from llie corresponding hspat samples 
Pi(ij). Theiefiire, the ad^ted WaDi algorithm in accordance willi flie invention is an 
^iproximate interpolation algprifhm. 
5 The interpolation step 32 interpolates the iiq>ut sample Pi(y) wifli an 

interpolator which prefi^ably uses a linear kemeL Hie clipped warping distances SLCx and 
SLCy determine how the output sample Po(nvn) has to be interpolated by weighting Hie 
adjacent input samples Pi(iJ) in the same manner as in the know WaDi 

The warped position x%y' in which the value f(x%y') of the output sample or 

10 pixel Po(x,y) has to be evaluated is influenced by three &ctors: 

the coordinates x,y of the output pixel Po we are inteipolating, 
the direction 8 of the local gradient which constrains the position of the ir^ut 
values ai used to calculate the waxping &ctor A, and 

die value of the warping strength parameter k. 

IS Fig. 5 shows a flowchart of part of another embodiment of the one step 

Waiped Distance concept in accoidance with the invention. Fi^^ S shows Ihe steps required in 
the step 1 which determines the duection of the local gradient 8(nMi) in accordance with the 
second embodiment discussed before. Now, step 1 comprises the steps IS and 16 instead of 
the steps 10 to 14 shown in Fig. 4. In step IS, the direction of the local gradients e(ij) is 

20 determined in the input image n for the input samples Pi. The step 16 rn^s these local 

gradients 8(iJ) £K>m the ixtput domain to the output domain to obtain local gradients 8(m,n) 
for the output pixels Po. The other steps of the WaDi processing of this embodiment in 
accordance with the invention are equal to the steps shown in Fig. 4. 

Fig. 6 shows a block diagram of a display apparatus con^rising the Warped 

25 Distance interpolator in accordance with the invention. An input video processor IVP 

processes input video IV to obtain the input image 11 comprising the input samples Pi. If the 
input video IV comprises the three RGB signals, the input video processor IVP may consprise 
aniatiixfordetenniiungtheluniinance value. The scaler WI comprises the WaDi 
interpolator in accordance with the invention which is Ihe known WaDi interpolator which is 

30 adapted to be able to process two-dimensional input images n in one step. The scaler WI 

supplies the output image OI which comprises the output saniples Po. Sucb a scaler is usually 
required in display ^aratuses which conq)rise a n:iatrix display. Such a matrix display has a 
native resolution determined by the number of pixels (display elements) in each row and the 
number of rows. On the other hand, the input image n has a resolution which may differ from 
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fhe native resolution of the matrix display. Thiis, the output sanq)les Po to be displayed on the 
pixels of the matrix display have to be interpolated fiom the ii^ut samples PL The scaler WI 
may receive the input video IV to be able to interpolate each of the three signals G and B, 
if present The output video processing processes the output video OI to obtain a video drive 
signal VDS suitable to drive the display device DP comprising Ifae display screen DS. 

To conclude, fte preferred CTabodim^t in accordance wifli Ibe invention is 
directed to a digital processor which performs the next steps in the order given. 

Interpolate 10 the input image n with a predetermined &st inteipolation 
method to obtain a roughly interpolated output image r(m^) conq>rising temporary output 
satrq>les Pot The ten^orary output samples Pot are determined for the purpose of using them 
to calculate the local gradient direction 6(m^) and are not meant to be displayed. 

Calculate the local gradient direction 6(m,n) in this roughly interpolated output 
image I'(m,n) with a simple algorithm such as the Sobel filters 1 1 and 12, the divider 13 and 
the arctan calculator 14, but other algorithms may also be used 

Determine 21 a number of interpolated input values ai along this gradient 
direction B(m,n) from the iiq>ut samples Pi(ij) of the input image n in selected 20 
predetermined positions located around the output pixel Po(m,n) we want to interpolate. Use 
these input values ai to match the edge model of the WaDi s^roach by calculating 22 the 
warping &ctor A. Use this warping fector A to calculate the warping along the gradient 
direction 0(m,n). 

Project 30 the calculated warping along the gradient direction 6(m,n) on the x 
and y axis, and perform a clipping 3 1 if necessary. Apply 32 the projectsed x and y warping 
components on the values of the phases Sx and Sy (representing the o£&et of the output 
samples Po(m,n) to be interpolated with respect to the closest i:5)per-left ixxpot pixels Pi(i J)) 
to calculate the warped position of the output sample Po(m,n). Use 32 a linear filtering 
technique to interpolate the output sample value Po(m,n) in the warped position accordingly. 
The output samples Po(m,n) are used to be displayed. 

The WaDi algorithm in accordance with the invention could be used every 
time an interpolation processing is required of photographic images or video. The algorithm 
performs best when scaling foctors groater than 2 aro requirod. For example, the algorithm 
may be used in video-wall applications, in photo-retouching softwaro and other context It 
could also be usefol inside integrated cirouits, such as, for example controllers of digital 
display systems. The algorithm could be implemented both in real time and batch processing 
applications. 
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It should be noted that the above-mentioned embodiments iUustrate lather than 
limit the invention, and that those skilled in the art will be able to draign many alternative 
embodiments wi&out departing fiom the scope of the appended claims. 

Although the WaDi processing in accordance with the invention has been 
S described for grey scale images, the same processing can be used for color images. If the 
WalM processor recdves RGB (Red, Green and Blue) ixqiut sigi^^ 
and SLy may be calculated by using the luminance value determined from fbe RGB input 
signals. The difference is that in the last step 32, the interpolation is applied three times, on 
each one of the RGB signals separately using the same values of the waiped distances SLx 
10 and SLy or the clipped warped distances SLCx, SLCy. 

In the claims, any reference signs placed between paienthesra shall not be 
construed as limiting the claim. Use of the verb ''conqmse" and its conjugations does not 
exclude tiie presence of elements or steps other than those stated in a claim. The article "a" or 
"an" preceding an element does not exclude the presence of a plurality of such elements. The 
IS invention may be inq[>lemented by means of hardware coroprising several distinct elements, 
and by means of a suitably programmed computer. In Hxe device claim enumerating several 
means, several of Ihese means maybe embodied by one and the same item of hardware. The 
mete fact that certain measures are recited in mutually different dependent claims does not 
indicate tiiat a conibination of these measures cannot be used to advantage. 
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CLAIMS: 



1. A method of inteipolatmg sanqple values (f) of sauries (Pi, Pot) of an image, 
fhe method comiirismg: 

detemiining (1) a diiection of a local gradient (G) of the sample values (f) for a 
particular one of the sanq>les (Pi^Pot) from san^le values (f) neighboring the particular one 
S of the samples (Pi, Pot), 

selecting (20) a position of interpolator inpat valuM (ai) in the direction of tiie 
local gradient (G) of the particular one of the samples (Pi, Pot), 

interpolating (21) the interpolator input values (ai) for the particular one of the 
samples (Pi^ot) fiom sample values (f) neighboring the interpolator input values (ai), and 
1 0 determining (22) in a single step a warping &ctor (A) for a warped distance 

interpolator (3) using the interpolator input values (ai). 

2. A method of interpolating saixxple values (f) of samples (Pi, Pot) of an image 
as claimed in claim 1, wherein: 

IS an output image (OI) is interpolated from an input image (II) in a system for 

digitally scaling the iiiput image (II) with mpM samples (Pi) having input sample values to 
obtain the ou^ut image (OI) with output samples (Po), 

the method further comprises interpolating (10) the input sample values to 
obtain interpolated terrq>orary output samples (Pot) having terttporary ou^ut sanople values 

20 (Tim^y). 

the determining (1) the direction of the local gradient (G) is arranged for 
detemuning a direction of the local gradient (0) for each one of the output sanq>les ^o) from 
neig^bboring temporary output sample values (I'(m,n)). 

25 3 . A method of interpolating sample values (f) of samples (Pi, Pot) of an image 

as claimed in claim 1, wherein: 

an output image (OI) is interpolated from an input image (II) in a system for 
digitally scaling the input image (U) with input samples (Pi) to obtain the ou^ut image (OI) 
with output samples (Po), 
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the detenniiUBg (1) the direction of the local gradient (6) is arranged for 
determining (1 5) a direction of the local gradient (9) fixr each one of the input samples (Pi) 
fiom neighboring iiq>ut sample values to obtain input ^nqple gradient valuK, and 

the melliod further conoptises mapping (16) of tiie input saniple gradient 
values to output gradient valura of tiie output sample (Po), wherein the corresponding one of 
the output gradient values is used as the local gradient (0) of the particular one of tiie samples 
(Pi, Pot). 

4. A method of interpolating sample values (f) of samples (Pi, Pot) of an image 
as claimed in claim 2, wherein the iapvA sanq>les (Pi) and the output samples (Po) are 
arranged in a matrix coxrprising rows of pixels in an x direction and columns of pixels in a y 
direction, the determining (1) the direction of the local gradient (9) comprises a first Sobel 
filtering (1 1) of the ten^orary output samples (Pot) in the x direction and a second Sobel 
filtering (12) in the y direction, the local gradient (9) of the output sanq^les (Po) being the 
arctangent of the second Sobel filtering (12) divided by the first Sobel filtering (1 1). 

5. A method of interpolating sanq[>le values (f) of samples (Pi, Pot) of an image 
as claimed in claim 2 or 3, wherein a distance (d) between adjacent interpolator input values 
(ai) is substantially equal to a distance between adjacent input sancples (Pi). 

6. A method of interpolating sarople values (f) of sanq^les (Pi, Pot) of an image 
as claimed in claim 2 or 3, wherein: 

the input samples (Pi) and the output samples (Po) are arranged in a matrix 
comprising rows of pixels in an x direction and columns of pixels in a y direction, and 

the determining (22) a warping &ctor (A) comprises projecting (30) the 
warping &ctor (A) on a x and y axis to obtain first and second warping components (Ax, 
Ay), respectively, and an interpolator (32) for interpolating the input samples (Pi) with 
modified distances determined by the first and second warping conqponents (Ax, Ay). 

7. A warped distance interpolator for interpolating sample values (f) of samples 
(Pi, Pot) of an image, said interpolator comprising: 

means for determining (1) a direction of a local gradient (9) of the sample 
values (f) for a particular one of the samples (Pi, Pot) from sample values (f) neighboring the 
particular one of the samples (Pi, Pot), 
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means for selecting a position (20) of interpolator input values (ai) in Hie 

direction of the lo(^ gradient (6) of the particular one of the san^les 

means for interpolating (21) Ihe interpolator input values (ai) for the particular 

one of flie rampl^ (Pi, Po) ficom pixel values (f) neighboring the interpolator input vahira 

(ai), and 

means for determining (22) in a single step a warping &ctor (A) for a warped 
distance interpolator (3) using the interpolator ii^ut values (ai). 



8. A display ^aratus comprising the warped distance interpolator (3) of claim 

10 7, and a display screen (DS). 
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ABSTRACT: 



In a method of inteipolatmg sample values (f) of samples (Pi, Pot) of an 
image, a direction of a local gradient (0) of the sample values (f) for a particular one of the 
sanqiles (Pi, Pot) is determined (1) from sample values (f) neighboring Ifae particular one of 
the samples (Pi, Pot). The positions of interpolator ixxpat valura (ai) are selected (20) in the 
S direction of the local gradient (8) of the particular one of the sauries (Pi, Pot). The 

interpolator input values (ai) for the particular one of the saooqples (Pi, Pot) are interpolated 
(21) from pixel values (f) neighboring the interpolator input values (ai). And, a waiping 
foctor (A) for a warped distance interpolating (3) is determined (22) using the interpolator 
iiq>ut values (ai). 

10 
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